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Navigation  is  Key 

•  Classical  approach 

-  sensors 

-  algorithms 

•  Biomimetic  approach 

-  sensors 


algorithms 


Classical  Approach  -  Sensors 
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Inertial  Measurement  Unit 


Crossbow  ANC-1000 

www.moog-crossbow.com 

Microstrain  3DM-GX3 

www.microstrain.com 

SBG  IG-500N 

www.sbg-systems.com 


acceleration 
angular  rate 
magnetic  field 

leads  to  estimation  of 

velocity 

position 

heading 


Classical  Approach  -  Sensors 
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Infrared  Time  of  Flight  Scanner 


Hokuyo  UTM-30LX  2D  range 

www.hokuyo.aut.jp/02sensor  max.  range  :  5  m  to  30  m 

Sick  LMS  111 

www.sick.com 

3D  range 

Velodyne  HDL-32E  max-  ran8e  ;  70  m 

www.velodynelidar.com 

working  principle: 
time  taken  for  laser  pulse  to  travel 
from  an  illuminator  to  objects  in  the 
FOV  and  back  to  the  detector 


Classical  Approach  -  Sensors 
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Infrared  Time  of  Flight  Camera 


MESA  SR4000 

www.mesa-imaging.ch 


3D  range 

max.  range  :  5  m 

working  principle: 
time  taken  for  light  to  travel  from  an 
active  illumination  source  to  objects  in 
the  FOV  and  back  to  the  sensor 


Classical  Approach  -  Sensors 
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Ultrasonic  Range  Finder 


Devantech  SRF 

http://www.robotshop.com/ca/sensors.html 


Maxbotix  XL-MaxSonar 

www.maxbotix.com 


Parallax  PING 

www.parallax.com 


ID  range 

max.  range  :  2  cm  to  10  m 
working  principle: 

time  taken  for  sound  to  travel  from  an 
active  transducer  to  objects  in  the 
beam  width  and  back  to  the  detector 


Classical  Approach  -  Algorithms 
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Reactive  Obstacle  Avoidance 

Instantaneous  mapping  of 
environment  and  path  generation. 

Durham  et  al.  (2008),  IROS,  1-9 

Minguez  &  Montano  (2004),  IEEE  Trans  Robotics  and 
Auto.,  Vol.  20,  45-59 

Simmons  (1996),  Proc  IEEE  Inti  Conf  Robotics  and 

Auto,  3375-3382 

Ulrich  &  Borenstein  (1998),  IEEE  Inti  Conf  Robotics 
and  Auto,  1572-1577 

Simultaneous  Localization  and  Mapping 

Incremental  build  of  a  spatially 
consistent  map  with  concurrent 
computation  of  location  within  the 
map  to  allow  path  planning. 

Celik  et  al.  (2008),  AIAA  GNC  Conf,  AIAA  2008-6670 
Grisetti  et  al.  (2007),  Robotics  and  Autonomous  Syst, 
Vol.  55,  30-38 

Structure  from  Motion 

Reconstruction  of  vehicle  pose 
relative  to  the  3D  environment 
through  feature-point  tracking  in 
successive  images. 

Prazenica  et  al.  (2007),  AIAA  GNC  Conf,  AIAA  2007- 
6830 

Watkins  (2007),  PhD  Thesis,  U  Florida 

Biomimetic  Approach  - 


Vision 

monocular  camera 
Centeye 

www.centeye.com 


optical  mouse  ADNS-2610 

https://www.sparkfun.com/products/10105 


PrimeSense 

www.primesense.com 
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Sensors 
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array  of  CCD  or  CMOS  detectors 

compound  eye  composed  of 
elementary  motion  detectors 

simple  elementary  motion  detector 


3D  scanner  using  structured  light 


Hierarchy  of  Technologies  for  Vision-based  Micro- 
Aerial  Vehicles 


Image  extraction 
Optical  flow  estimation 
Feature  extraction 


Vehicle  control  law 


Actuator  commands 


Image  Extraction 


•  160x120  pixels,  10  fps,  computation  time  =  0.23  s 


(a)  Position  #  1  (b)  Position  #2  (c)  Position  #  3  (d)  Position  #  4 


•  320x240  pixels,  30  fps,  computation  time  =  2.26  s 


II 


19Q  " 


(a)  Position  #  1 


(b)  Position  #  2 


(c)  Position  #  3 


(d)  Position  #  4 
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Optical  Flow  Estimation 

•  Optical  flow  due  to  general  camera  motion 

Coombs,  D.  et  al.  (1998),  IEEE  Trans  Robotics  and  Automation,  Vol.  14,  49-58. 

u  =  (1  /Z)(—Tx  +  xTz )  +  \xyux  —  (1  +  x2)(jjy  +  yuiz 
v  =  (1/Z)(— Ty  +  yTz )  +  [(1  +  y‘2)ux  —  xyujy  —  xujz 


•  Optical  flow  based  on  image  pixel  brightness 


11 


Optical  Flow  Estimation 

•  Horn  &  Schunck  -  global  smoothness  constraint 

Horn  and  Schunck  (1981),  Artificial  Intelligence,  Vol.  17,  185-203. 


E  =  fj  ( lxu  +  Iyv  +  4)2  +<x2  (||Vu||2  -I-  |Vv||2)]  dxdt 

dxdy 

Liu  (Lucas  &  Kanada)  -  local  smoothness  constraint 


Lucas  and  Kanade  (1981),  Proc.  Of  DARPA  Image  Understanding  Workshop,  121-130. 
Liu  (2009),  PhD  Thesis,  MIT 


nq_ 

2  ytodbtot) 

-1 

teJ" 

% I,W  . 

•  Other  algorithms 

vision.middlebury.edu/flow/eval 


Feature  Extraction  -  Time  to  Contact 
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•  TTC  based  on  flow  divergence 

Coombs,  D.  et  al.  (1998),  IEEE  Trans  Robotics  and  Automation,  Vol.  14,  49-58. 


du 

dx 

dv 

dy 

Tc 


pTz  +  i)lox  —  2xojy 
pTz  +  2yojx  —  xu)y 

— — — -  at  (x,  y)  =  (0,0) 

V{u,v) 


•  TTC  at  pixel  location  (x,  y) 

Low  &  Wyeth  (2005),  Australasian  Conf  Robotics  and  Automation,  1-10. 

^  COS(/)  X  sin(/>  (/)  =  u  cos  0+  v  cos  6 

c  =  ~T  (f)  =  spherical  angle  between  optical  axis  and 

*r  vector  from  focal  point  to  pixel  on  image 

plane 

6  =  polar  angle  on  image  plane 


Navigation  Law 

Global  TTC 
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n  171 


T, 


cbalance 


Tr  =  K 


n/2  rri 

i= 0  j= 0  i=n/ 2  j= 0 

n  m 

scaling  £  ^Tc(i,j) 

2=0  J=0 


Heading  and  speed  commands 


7T  7T 

^ 'Pcmd  (  7777  *  (-^c)  "I-  ~T )  *  ^^9^  (Rebalance) 

oo  4 

1  ,  1 

Vcrnct  (  Yg  *  (-^c)  *  52 QTt{^I cbalance) 


Quadrotor  Control  Law 


Simplified  control  law  for  simulation  study  only. 


Comparison  of  Optical  Flow  Estimation  Methods 
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Obstacle  Avoidance  Simulation  -  1  Obstacle 


H&S  optical  flow 


Liu  optical  flow 


0I - - * - * - ‘ 
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0  5  10  15  20 

Time  (s) 
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Obstacle  Avoidance  Simulation  -  5  Obstacles 


H&S  optical  flow 


Liu  optical  flow 
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Summary 


DEFENCE 


•  Classical  navigation  approach  comprised  of  sensors  that  measure  distances 
to  objects  and  algorithms  that  exploit  absolute  distance  measurements  to 
compute  navigation  commands. 

•  Biomimetic  approach  comprised  of  sensors  that  pixelate  objects  in  an 
image  plane  and  algorithms  that  exploit  pixel  movement  to  deduce  object 
location  in  order  to  compute  navigation  commands. 

•  As  the  size  of  a  micro-aerial  vehicle  reduces,  the  viability  of  using  classical 
navigation  methods  decreases  unless  classical  navigation  sensors  have  a 
dramatic  decrease  in  size,  weight  and  power  consumption. 

•  Vision-based  navigation  methods  may  offer  an  avenue  to  miniaturize  the 
navigation  sub-system  on  micro-aerial  vehicles.  However,  further 
development  to  increase  the  robustness  of  optical  flow-based  navigation 
algorithms  is  required. 
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